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Abstract — The belief propagation algorithm has been recog- 
nized in the information theory community as a soft-decision 
iterative decoding algorithm. It is the most powerful algorithm 
found so far for attacking hard optimization problems in channel 
decoding. Quantum mechanics is the foundation of modern 
physics with the time-independent Schrodinger equation being 
one of the most important equations. This paper shows that the 
equation can be derived from a generalized belief propagation 
algorithm. Such a connection on a mathematical basis might 
shed new insights into the foundations of quantum mechanics 
and quantum computing. 
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I. Introduction 



The maximum likelihood (ML) decoding of channel codes 
can be viewed as a computational task of finding the global 
minimum of an energy (objective) function. The belief propa- 
gation (BP) algorithm [1] is the most powerful one recognized 
by the information theory community [2] to accomplish the 
task. The new generation channel codes such as Turbo codes 
and low-density parity-check (LDPC) codes combined with 
BP decoding can achieve remarkable performance close to the 
Shannon limit. 

The a posteriori probability (APP) algorithm [3] is a simpli- 
fied variation of the BP algorithm. Given a multivariate energy 
function E(xi,X2, ■ ■ ■ ,x n ) of the following form 

E(xi,X2, ■ ■ ■ , x n ) = ei(xi) + ^ ei^Xi.Xj) 

i \ j-J<i 

with the assumption of the symmetric binary component 
functions ey(xj, Xj), i.e., eij(xi,Xj) = eji(xj,X{), for any 
i,j. The APP algorithm can be applied to find an approximate 
solution to minimize the energy function. It is based on a 
method of updating and passing n messages, ipi {xi , t) for 
i = 1, 2, . . . , n, in an iterative way as follows, 

1pi(Xi,t + 1) = 



Zi(t + l) 



,- ei ( x< )/ft. 



(1) 
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where h is a positive constant, related to the channel char- 
acteristics in channel decoding. Zi{t + 1) is a normalization 
factor at time t + 1, such that 

);ipi(xj,t + 1) = 1, for i = 1,2, . ..,n . 

Xi 

The message ipi (xi ,t) is a soft-decision for assigning vari- 
able Xi at time t. It is a real-valued, non-negative function 
called the soft-assignment function in this paper. It measures 
in a quantitative way the preferences over different values of Xi 
for minimizing the energy function. The best candidate value 
for assigning Xi at time t is the one of the highest function 
value ipi(xi,t). Often times at decoding channel codes, each 
soft assignment function ipi (x-i , t) is progressively peaked at 
one variable value while the rest reduced to zero as the 
iteration proceeds. That is to say that the algorithm eventually 
decides on a unique value for each variable at those instances. 
The density evolution [4] is a powerful technique invented by 
the information theory community to understand and analyze 
this kind of processes. 

II. A Generalization of the APP Algorithm 

The difference equations (Q]) of the APP algorithm, can be 
generalized by raising the soft-assignment function ipi (xi , t) 
at the right side of the equations to a power a, 

1 



1pi(Xi,t+ 1) = 



Z t (t + 1) 




(2) 



When a = 1, the above generalization falls back to the original 
one. 

It has been shown that the BP algorithm can only converge 
to a fixed point that is also a stationary point of the Bethe 
approximation to the free energy [5]. It is also not hard 
to prove that each valid codeword can be a fixed point 
when the APP algorithm is applied to decode a LDPC code 
with the degree of each variable node d v > 2 (or the BP 
algorithm when d v > 3). The algorithm will converge with an 
exponential rate to a fixed point of this kind when it evolves 
into a state close enough to any one of them. 



To improve the performance of the APP algorithm further, 
we can smooth the soft assignment functions ipi(xi,t) to 
prevent the algorithm from being trapped to an un-desired 
fixed point. One way to smooth the soft assignment function 
ipi(xi,t) is given as follows, 

where \Di \ is the domain size of variable Xi, and the parameter 
(3 is the smoothing factor satisfying < (3 < 1. When (3=1, 
the function ipi(xi,t) is completely smoothed out. 

The smoothing operation defines an operator on the soft 
assignment functions t/j i (xi,t), denoted as S(-). With that 
definition, we can generalize the APP algorithm (O further 
as follows, 

il>i(Xi,t + 1) = —r rS( e~ ei ^/ h - 

X\C£e-^^l h \^{x 3 ,tY)). (3) 

It has been found that the generalized APP algorithm (O 
can sometimes significantly improve the performance of the 
original one at decoding LDPC codes. We have observed im- 
provements over ldB to 2dB in our experiments at decoding 
commercial irregular LDPC codes (such as LDPC codes used 
for China's HDTV) and regular experimental LDPC codes. 

III. Deriving Schrodinger Equation 

Let the parameter a = 2 in the generalized AP algo- 
rithm (O. If all variables XjS are in a continuous domain, the 
generalized APP algorithm (O becomes 



n 

3,3^1 



dxj e 



(* + l) 



(4) 



The soft assignment function ipi(xi,t) can be generalized 
from a real-valued, non-negative function to a function over 
the complex domain C. It has no impact on the optimization 
power of the generalized APP algorithm ©. In this case, it 
is the magnitude of the function \ipi(xi,t)\ instead of itself 
that measures the preferences over different values of x^. For 
ipi(xi,t) e C, \ipi(xi,t)\ is defined as y/ip?(xi,t)ilii(xi,t). 

Let At be an infinitesimal positive value and the soft 
assignment function at t + At be i/>i(xi, t+At). The difference 
equations of the generalized APP algorithm in a continuous 
time version is 



[] J dxj e-^/^^'Vifo.t)! 2 ). (5) 

3,j¥=i 

When At — * 0, the term inside the operator S(-) at the right 
side of (O approaches ipi(xi,t). 



Starting from an initial state, the generalized APP algorithm 
described by © will evolve toward one of its equilibriums 
over time. It will be shown in the following that the algorithm 
at its equilibrium is, in fact, the time-independent Schrodinger 
equation. 

Since variable Xi is in a continuous domain, let the smooth- 
ing operator S(-) on the soft assignment function ipi(xi, t) be 
defined as 

S(ipi(x 2 ,t)) = J K(u — Xi)ipi{u,t) du , 

where K(x) is a smoothing kernel. If xi is in the one 
dimensional space R, we can choose the following Gaussian 
function as the smoothing kernel K(x), 

K(x) = J_ e ~* 2 /2a?At _ (6) 

\/2nAta l 

With the Gaussian smoothing kernel, the dynamic equa- 
tions (O become 

^( Xl ,t + At)= ' 



Zi(t + At) 



du 



1 



y/ZnAtai 



(7) 



3,3^ 



Expanding the right side of the above equation into a Taylor 
series with respect to At and let At — > 0, we have 

dtpi(x,t) af d 2 tp(xi,t) 



dt 



dx] 



1 



Vi(xi)~ipi(xi,t) +ei{t)ipi(xi,t) , (8) 



where 



V i {x l ) =ei(xi)+ ^2 J dxj eij(xi,Xj)\tpj(xj,t)\ 2 , 



and 



Si(t) = - 



d Zj{t)/d t 



Let the operator Vf be defined as 

d 2 ip(xi,t) 



viip(xi,t) 



dxj 



and Hi be an operator on ip(xi,t) defined as 

fli = ~V i 2 + 7 < (x i ). (9) 
Then the equations ^ can be rewritten as 

dipi(x, t) 



1 



Hi^xut) + £i(t)ipi(xi,t) 



(10) 



dt h 

When the differential equations (TTOb evolve into a stationary 
state (equilibrium), they become 

Ei%l)i(xi,t) = Hitpi(xi,t), for i = 1,2, ...,n , (11) 

where Eu E{ = hei, is a scalar. 



For a physical system consisting of n particles, let Xi be 
the position of particle i, 1 < i < n, in the one dimensional 
space R. Let af — h/rrii, where nij is the mass of particle i. 
Then equations ( fTTT > become 

Ei^i{xi,t) = (—^—^l + V^Xt)) ^i( Xi ,t) . (12) 
V 2m, / 

They are the conditions for the physical system to be in a sta- 
tionary state when its dynamics is defined by the generalized 
APP algorithm. Equation ( fT2l is also the time-independent 
Schrodinger equation. (It is straightforward to generalize this 
derivation to three dimensions, but it does not yield any deeper 
understanding.) 

In conclusion, from a pure mathematical observation, the 
time-independent Schrodinger equation is derivable from a 
soft-decision iterative decoding algorithm. From the derivation 
we can see that the soft decisions ipi (xt , t) of the decoding 
algorithm are the classic wavefunctions in the Schrodinger 
equation. 
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